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Knowledge-Based  Systems  Research 
Final  Report 


This  is  the  final  report  on  Knowledge-Based  Systems  Research,  under  the  terms  of  Contract  # 
N00039-86-C-0033,  issued  by  the  Space  and  Naval  Warfare  Systems  Command.  The  official  start 
date  of  the  contract  was  August  22, 1986,  although  research  actually  began  on  October  10,  1985,  when 
pre-award  costs  were  approved.  The  contract  ended  on  March  31,  1990. 

Knowledge-Based  Systems  Research  covers  research  on  the  following  topics: 

1.  Blackboard  model  of  problem  solving 

2.  Constraint  satisfaction 

3.  Machine  learning  and  knowledge  acquisition 

4.  Symbolic  simulation 

5.  Logic-based  systems  with  self-awareness 

6.  SOAR,  an  architecture  for  general  intelligence  and  learning 

7.  Software  design  by  redesign 

Task  Objectives 

Blackboard  Systems:  Deepen  scientific  understanding  and  improve  the  power  and  range  of 
application  of  this  framework  for  problem-solving.  Design  and  implement  an  environment  in 
which  blackboard  systems  and  applications  can  easily  be  built,  providing  facilities  for  controlling 
reasoning,  explaining  actions,  and  learning  new  problem  solving  strategies. 

Constraint  Satisfaction:  Produce  tools  for  constructing  symbolic  constraint  satisfaction 
programs,  and  analyze  their  performance  to  evaluate  strengths  and  limitations  in  problem¬ 
solving. 

Machine  Learning  and  Knowledge  Acquisition:  Develop  robust  machine  learning  programs  to  be 
integrated  in  a  variety  of  intelligent  systems.  Determine  criteria  for  application  of  machine 
learning  techniques  to  various  problem-solving  architectures. 

Symbolic  Simulation:  Develop  concepts  and  software  for  symbolic  simulation  of  complex, 
dynamic  systems.  Build  representation  schemer-  for  time  course  of  events  and  develop  animation 
techniques  to  improve  user  understanding  of  modeled  behavior. 

Logic-based  systems  with  self-awareness:  Explore  and  implement  new  reasoning  techniques, 
viz.  uncertain  reasoning  for  resolution,  theory  formation  based  on  measures  of  probability  and 
simplicity,  efficiency-enhancing  theory  reformulation,  and  counterfactual  implication. 

SOAR:  Formulate  a  general  abstraction-planning  mechanism  and  a  general  problem-space 
creation  mechanism.  Demonstrate  SOAR  on  several  large  tasks.  Perform  experiments  to 
determine  the  sufficiency  of  chunking  as  a  general  learning  mechanism.  Complete  revision  of 
SOAR  into  a  robust,  efficient,  user-friendly  system,  capable  of  helping  the  user  give  it  new  tasks. 

Software  design  by  redesign:  Develop  a  design  environment  to  support  and  complement  the 
skills  of  human  software  designers.  Develop  a  representation  for  software  designs  and 
specifications  with  multiple  perspectives.  Build  a  prototype  library  of  software  modules.  Develop 

methods  for  modification  and  propagation  of  design  changes.  Develop  a  user  interface  language . _ 
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Technical  Problems 


No  significant  technical  problems  were  encountered. 

General  Methodology 

The  methodology  employed  in  all  phases  of  this  research  has  been  engineering-oriented  and 
experimental.  That  is,  research  problems  are  explored  by  designing,  building  and  experimenting 
with  programs  that  serve  to  test  underlying  theories. 

Technical  Results 

In  this  final  report  we  give  a  brief  synopsis  of  research  in  each  of  the  topic  areas.  An  extensive 
bibliography  of  publications  that  were  written  under  this  contract  is  presented  in  the  appendix. 

1.  Blackboard  model  of  problem  solving 

A  blackboard-based  problem  solving  architecture,  BB1,  was  completed  and  released  (version 
v2.0).  A  more  general  framework,  called  BB*,  was  also  completed  and  released  (version  vl.O). 
Both  systems  are  available  in  CommonLisp.  Copies  of  each  implementation  were  distributed  to 
several  academic  and  industrial  research  organizations  that  had  been  awaiting  them.  BBl's 
system-building  support  and  run-time  capabilities  were  extended  in  several  areas:  (a) 
declarative  representation  of  large  bodies  of  factual  and  heuristic  knowledge;  (b)  integration  of 
multiple  reasoning  skills  in  a  single  system;  (c)  dynamic  control  under  real-time  constraints. 
We  have  implemented  these  application-independent  components:  (a)  declarative  representation 
for  device  structure,  function,  faults,  and  repairs;  (b)  reasoning  modules  for  associative  and 
model-based  diagnosis;  and  (c)  an  asynchronous  communications  interface.  These  components 
were  demonstrated  in  the  GUARDIAN  system  for  managing  medical-intensive-care  patients  in 
real  time  (see  below). 

BB*  permits  the  integration  of  BB  1  with  application  specific  frameworks  which  include 
knowledge  and  terminology  about  specific  tasks.  One  such  framework  is  ACCORD,  which  tailors 
the  system  for  the  task  of  arranging  objects  to  satisfy  constraints.  The  utility  of  ACCORD  has  been 
demonstrated  for  system  design,  implementation,  and  performance  in  two  application  systems: 
the  PROTEAN  system  for  protein  structure  modeling  and  the  SIGHTPLAN  system  for  designing 
construction-site  layouts.  ACCORD  (version  vl.O),  written  in  CommonLisp,  has  also  been 
released. 

A  new  application,  called  GUARDIAN,  was  developed  for  managing  patients  in  medical 
intensive  care.  This  application  permits  exploring  such  issues  as 
interfacing  a  reasoning  system  to  the 

external  environment,  modeling  dynamic  systems,  and  using  real-time 
constraints  on  reasoning  and  problem  solving. 


GUARDIAN  Demo-2  was  completed.  It  performs  the  following  functions  in  real  time:  (a) 
monitors  and  filters  data  from  a  respirator  according  to  dynamically  specified  I/O  filters;  (b) 
dynamically  adjusts  I/O  filters  so  that  the  system  monitors  data  at  the  maximum  rate,  given  its 
current  reasoning  activities;  (c)  classifies  data  in  meaningful  temporal  episodes;  (d) 
probabilistically  diagnoses  abnormal  episodes:  fel  uses  genmic  flow  models  to  explain  the 
respiratory  system  structure,  function,  and  faults  underlying  particular  diagnoses;  and  (f)  uses 
generic  flow  models  to  hypothesize  alternative  diagnoses.  In  developing  Demo  2,  we  addressed 
research  issues  related  to  selective  attention,  representation  and  use  of  generic  structure/function 
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models,  incremental  diagnosis  over  time,  integrating  multiple  reasoning  activities,  and 
coordination  with  a  dynamic  external  environment. 


A  two-part  paper,  Blackboard  Systems,,  by  H.  Penny  Nii,  was  published  in  the  AI  MAGAZINE. 
Volumes  7,  No.  2  and  Volume  7,  No.  3.  The  paper  explains  what  is  meant  by  the  blackboard  model 
of  problem  solving,  defines  a  computational  framework  for  blackboard  systems,  traces  the 
intellectual  history  of  the  "blackboard"  ideas,  and  describes  and  contrasts  half-a-dozen 
blackboard  application  programs. 

A  full-length  book,  also  entitled  Blackboard  Systems,  was  completed  and  published  by  Addison- 
Wesley  in  1988.  The  book,  edited  by  R.  Engelmore  and  A  Morgan,  is  a  collection  of  most  of  the 
major  technical  papers  on  blackboard  systems  through  1986. 

2.  Constraint  satisfaction 

Constraint  satisfaction  techniques  were  explored  in  the  context  of  two  different  application 
domains,  budgetary  constraints  for  financial  resource  management  and  spatial  constraints  for 
molecular  structure  determination. 

For  the  financial  resource  management  application  we  built  a  system  called  FRM  for  creating 
proposal  budgets  and  matching  records  of  expenditures  with  budgets.  In  FRM,  all  financial 
management  domain  knowledge  is  represented  in  the  constraint  form.  The  preferences,  policies, 
and  procedures  that  the  FRM  system  uses  in  resource  management  are  written  in  the  form  of 
symbolic  constraints  that  are  applied  to  appropriate  items  in  a  developing  budget.  The  constraint 
management  program  propagates  constraints  and  attempts  to  satisfy  them  sequentially. 

For  the  spatial  constraint  application,  we  developed  a  system  called  PROTEAN  for  determining 
the  three-dimensional  structure  of  protein  molecules  from  NMR  data.  PROTEAN  incorporates 
high  speed  geometric  calculations  for  spatial  arrangement  problems  and  uses  BB1  knowledge 
sources  to  control  the  direction  and  order  of  constraint  propagation.  PROTEAN  has  been  used 
successfully  to  partially  assemble  various  proteins  subject  to  experimental  and  theoretical 
constraints.  The  system  was  later  expanded  with  the  addition  of  new  functionality  to  refine  a 
protein  at  the  atomic  level  of  resolution.  To  demonstrate  and  validate  these  capabilities, 
constraints  generated  from  a  known  protein  (cytochrome-b562)  were  used  to  reconstruct  the 
structure  at  the  atomic  level  of  detail,  yielding  a  family  of  atomic  structures  as  a  reasonable 
depiction  of  the  molecular  structure. 

3.  Machine  learning  and  knowledge  acquisition 

Investigations  were  carried  out  in  a  number  of  different  sub-areas  of  machine  learning  and 
knowledge  acquisition,  including  learning  by  induction,  apprenticeship  learning,  intelligent 
editors,  text  learning,  communication  patterns  between  knowledge  engineers  and  experts,  and 
learning  by  analogy. 

A  number  of  experiments  were  conducted  with  a  rule  induction  program,  RL,  which  showed  how 
intelligent  selection  of  instances  increases  the  efficiency  of  learning  from  examples.  Other 
experiments  with  RL  were  conducted  in  the  domain  of  high  energy  physics  to  show  the  generality 
of  RL’s  method.  These  experiments  demonstrated  that  a  simulation  program  can  effectively 
provide  training  examples  for  a  learning  program.  Another  series  of  experiments  were 
performed  with  RL  to  determine  the  effectiveness  of  learning  from  examples  of  different  types, 
especially  for  the  concept  of  a  "near  miss." 
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A  prototype  program  that  learns  by  watching  how  an  expert  solves  a  diagnosis  problem  was 
implemented.  Designed  Meta-OPAL,  a  framework  for  building  intelligent  editors  and  began 
implementation.  The  REFEREE  program  which  critiques  articles  on  clinical  trials,  was 
rewritten  from  EMYCIN  into  the  object-oriented  language  KEE  to  allow  interactive  acquisition  of 
new  knowledge  from  published  journal  articles.  A  long-term  study  of  communication  patterns  in 
the  interaction  of  experts  and  knowledge  engineers  was  initiated  Research  was  completed,  under 
M.  Genesereth's  direction,  on  a  deductive  approach  to  analogical  reasoning. 

4.  Symbolic  simulation 

We  explored  qualitative  simulation  as  a  means  of  representing  theories  of  gene  regulation  in 
molecular  biology,  and  developed  several  new  qualitative  representation  and  reasoning 
techniques.  This  work  is  fully  documented  in  the  Ph.D.  dissertation  of  Peter  Karp,  entitled 
"Hypothesis  Formation  and  Qualitative  Reasoning  in  Molecular  Biology." 

During  the  summer  we  made  progress  in  developing  a  process-oriented  simulation  system  for  the 
tryptophan  operon.  The  thesis  describes,  among  other  things,  a  process-oriented  simulation 
system  for  the  tryptophan  operon.  The  important  objects  in  this  biological  system  and  the 
important  interactions  between  them  were  identified,  thus  enabling  the  simulation  of  all 
important  processes  in  the  operon  such  as  chemical  binding  events,  and  protein  translation.  In 
addition  to  the  library  of  biological  objects,  the  system  includes  a  means  of  describing  initial 
experimental  conditions,  and  a  partial  library  of  processes  which  describe  interactions  between 
objects.  An  interpreter  was  implemented  which  executes  these  processes  in  a  fashion  similar  to  a 
production  system.  The  interpreter  can  be  run  to  compute  the  topology  of  a  reaction  network  for  a 
given  set  of  initial  conditions.  Construction  of  the  knowledge  base  raised  a  number  of  important 
issues  in  constructing  large  knowledge  bases. 

The  use  of  simulation  techniques  for  automated  discovery  of  process  mechanisms  was 
investigated.  A  process-oriented  simulation  system  was  developed  for  generating  and  testing 
hypotheses  about  biological  regulation  mechanisms. 

A  successful  prototype  of  an  expert  system  that  combines  rule-based  symbolic  reasoning  with 
numerical  optimization  and  simulation,  for  diagnostic  troubleshooting  of  a  particle  beam 
accelerator,  was  also  completed. 


5.  Logic-based  systems  with  self-awareness 

Work  on  advanced  inference  techniques  stressed  formalization  of  the  notion  of  irrelevance,  the 
investigation  of  the  expressive  and  computational  properties  of  defeasible  inference,  and  the 
application  of  counterfactual  inference  to  planning. 

Work  on  multi-valued  logics  focussed  on  the  implementation  of  a  backward  chainer.  A  multi¬ 
valued  inference  engine  was  developed  that  has  been  specialized  to  yield  a  first-order  theorem 
prover,  an  assumption-based  truth  maintenance  system,  and  a  default  reasoner  (both  with  and 
without  justification  information).  The  program  has  been  used  to  successfully  solve  a  variety  of 
problems  in  the  simulation  and  diagnosis  of  digital  hardware 

Work  on  advanced  reasoning  progressed  on  four  fronts:  control  of  reasoning,  reasoning  about 
action,  theory  of  abstraction  reformulations  for  computational  efficiency,  and  the  implementation 
and  integration  of  these  methods  into  the  MRS  system. 
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This  research  includes  work  on  1)  automatic  compilation  of  MRS  axioms  into  efficient  code;  2) 
implementation  of  automatic  control  in  MRS;  3)  work  on  theory  and  implementation  of 
abstraction  reformulations;  and  4)  work  on  reasoning  about  derived  information  over  time  . 


6.  SOAR,  an  architecture  for  general  intelligence  and  learning 

The  Soar  project  is  focused  on  the  task  of  developing,  applying,  and  evaluating  an  architecture 
usable  as  the  basis  of  an  integrated  intelligent  agent.  By  its  nature,  such  an  effort  spans  a  large 
part  of  AI.  The  segment  of  the  Soar  project  that  has  been  funded  through  Darpa  contract  N00039- 
86C-0033  to  the  Stanford  Knowledge  Systems  Laboratory  has  focused  on  making  contributions  in 
the  areas  of  abstraction,  integrated  models  of  learning,  self-compiling  expert  systems,  and 
production  system  technology  .  In  addition  to  b^ing  contributions  in  their  own  right,  each  of  these 
pieces  contributes  to  the  overall  capabilitie  s  of  the  Soar  ryst' m.  These  four  areas  of  contribution 
are  summarized  below,  followed  by  a  few  words  on  the  integr  ation  of  rules  and  case- 
based/analogical  reasoning. 

In  the  area  of  abstraction,  we  have  been  examining  how  abstraction  can  arise  automatically,  and 
how  it  can  integrate  synergistically  with  problem  solving  (or  planning)  and  learning.  We  have 
developed  a  family  of  methods  that  can  automatically  simplify  task  descriptions,  learn  from  the 
simplified  task  descriptions,  and  transfer  what  is  learned  to  reduce  the  effort  required  to 
accomplish  the  full  task.  In  the  process,  these  methods  increase  the  tractability  of  the  learning 
method,  and  enable  the  acquisition  of  generalized  rules.  The  family  of  methods  includes  a  very 
weak  method  of  broad  applicability,  plus  stronger  iterative  and  assumption-counting  methods. 
These  methods  have  been  implemented  in  Soar,  and  shown  to  be  effective  in  three  disparate 
domains:  a  puzzle  domain  (eight  puzzle),  a  planning  domain  (Strips-like  mobile  robot),  and  an 
expert  system  domain  (computer  configuration).  Three  of  the  key  ways  that  these  methods  differ 
from  earlier  abstraction  methods  are:  (1)  that  they  automatically  determine  what  to  abstract  (and 
when  to  abstract  it);  (2)  that  they  dynamically  and  incrementally  abstract  the  behavior  of  the 
system,  rather  than  statically  abstracting  the  structure  of  the  system  (during  a  preprocessing 
phase);  and  (3)  that  they,  because  of  their  implementation  in  Soar,  lead  to  the  acquisition  of  abstract 
rules  -  which,  in  combination,  form  an  abstract  plan  —  that  can  transfer  to  later  tasks. 

In  the  area  of  integrated  models  of  learning,  we  have  been  attempting  to  understand  the  span  of 
learning  behaviors  possible  via  chunking  in  Soar.  Our  hypothesis  is  that  this  covers  the  full  range 
of  learning  behaviors  required  of  an  intelligent  agent.  Towards  this  end  we  have  developed  and 
implemented  a  framework  which  integrates  together  three  of  the  principal  forms  of  machine 
learning:  rote  learning,  induction  from  multiple  examples,  and  explanation-based  learning. 

The  framework  shows  how  all  three  can  arise  from  chunking,  if  the  variety  of  searches  over  which 
chunking  works  is  sufficiently  wide.  Also,  as  part  of  this  integration,  we  have  shown  how 
chunking  can  acquire  three  of  the  key  types  of  knowledge  required  of  an  intelligent  system: 
procedural  knowledge,  episodic  knowledge,  and  declarative  knowledge.  This  work  has  provided 
novel  solutions  to  several  of  the  key  problems  in  explanation-based  learning  (EBL),  such  as  how 
EBL  can  learn  truly  new  things,  how  EBL  can  be  integrated  with  other  forms  of  learning,  and  how 
to  decide  what  concepts  EBL  should  be  used  to  learn  about. 

In  the  area  of  self-compiling  expert  systems,  we  have  been  investigating  how  to  construct  "first 
principles”  expert  systems  in  Soar,  and  how  they  can  then  automatically  compile  themselves,  via 
chunking  (EBL),  into  shallower,  more  efficient  systems.  Our  early  work  -  prior  to  this  contract  - 
was  in  the  area  of  computer  configuration  --  a  classical  construction  expert  system.  The  work  on 
abstraction  in  computer  configuration  (described  above)  was  an  attempt  to  reduce  the  searches  that 
are  required  before  such  learning  can  occur,  and  to  further  speed  up  the  compilation  by  learning 
more  general  rules  (so  fewer  overall  need  be  learned).  Our  other  major  effort  was  an 
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investigation  into  a  very  different  style  of  expert  system  —  a  classical  classification  expert 
system.  Neomycin-Soar  is  a  medical  diagnosis  expert  system  that  is  a  reimplementation  of  the 
Neomycin  system  (which  is  itself  a  reimplementation  of  the  Mycin  system).  It  is  the  largest  expert 
system  to  have  been  built  in  Soar,  at  approximately  5000  rules.  The  results  of  this  effort  were:  (1)  a 
demonstration  that  both  classification  and  construction  tasks  map  cleanly  onto  Soar's  basic 
generate-select-execute  cycle;  (2)  a  demonstration  that  a  Neomycin-like  "first  principles" 
approach  could  be  automatically  compiled  down  to  a  tight  question-asking  loop,  where  learned 
rules  are  used  directly  to  determine  what  question  to  ask  next,  and  what  the  consequences  of  the 
answer  are;  and  (3)  that  a  major  source  of  the  learning-induced  speedup  comes  from  rules  that 
avoid  dead-ends  in  the  reasoning  process. 

In  the  area  of  production  system  technology,  we  have  been  working  towards  efficient  and  bounded 
production  matchers.  The  production  matcher  is  in  the  inner  loop  of  Soar  (and  other  systems),  and 
both  efficiency  and  boundedness  are  required  for  effective  performance,  especially  as  we  head 
towards  real-time  domains.  On  the  efficiency  side,  we  have  developed  an  optimized  RETE-based 
matcher  for  Soar  that,  among  other  things,  incorporates  a  sophisticated  condition  reorderer.  We 
have  also  implemented  a  TREAT-based  matcher  for  Soar,  and  have  shown  experimentally  that 
RETE  outperforms  TREAT  under  a  set  of  identifiable  assumptions  that  are  met  by  Soar.  On  the 
boundedness  side,  we  have  developed  a  space  of  novel  production  system  formulations  that  admit 
polynomial-time  match  algorithms.  The  unique-attribute  formulation,  which  has  a  linear-time 
match  algorithm,  has  been  shown  to  eliminate  the  problem  of  expensive  chunks  -  where  the 
acquisition  of  new  rules  degrades  performance  because  of  their  exponential  match  cost.  While 
none  of  the  new  formulations  yet  appears  ideal,  several  have  proved  to  be  interesting  contenders 
for  replacing  the  current  Ops5-style  formulation.  They  also  reveal  an  interesting  connection 
between  production  matching  and  constraint  satisfaction  problems. 

One  effort  that  was  spawned  by  supported  work  on  analogy  in  Soar,  and  that  continued  to  be 
supported  under  this  contract  though  it  was  continued  outside  of  the  Soar  system,  was  on  the 
integration  of  rules  with  case-based/analogical  reasoning.  This  work  has  so  far  made  a  number 
of  contributions,  most  notably  in  the  area  of  how  to  use  cases  that  do  not  come  predigested  with 
rationales  for  their  various  actions.  A  rational-reconstruction  technique  has  been  developed 
whereby  plausible  explanations  are  generated  for  the  cases  (from  weak  background  theories),  and 
then  used  as  the  basis  for  analogical  transfer  to  new  situations.  A  second  contribution  is  the 
development  of  a  metric  that  determines  when  to  accept  the  results  of  the  available  rules,  or  when  to 
instead  use  analogy  to  override  what  the  rules  suggest. 


7.  Software  design  by  redesign 

During  the  course  of  our  research  in  blackboard  systems,  a  collaborative  research  project  was 
initiated  between  KSL  and  Kestrel  Institute  to  investigated  the  design  of  software  architectures. 
Software  designers  often  design  new  systems  by  remembering  and  modifying  a  "similar” 
conceptual  design  they  used  in  the  past.  The  objective  of  this  project  is  to  develop  a  system  that 
provides  aid  in  this  process. 

During  the  period  of  this  contract  we  developed  an  initial  knowledge  representation  scheme  for 
describing  software  architectures,  and  built  a  prototype  knowledge  base  (library)  of  blackboard 
architectures  and  their  components.  A  scheme  for  representing  functional  modules  from  various 
perspectives  was  proposed.  Using  this  scheme  generic  components  of  blackboard  architectures 
were  built  up  from  the  perspectives  of  functional  decomposition  hierarchy,  control  flow,  and  data 
flow.  Some  "redesign  operators"  were  identified  that  are  intended  to  transform  the  components  in 
the  library  into  ones  with  different  characteristics  that  would  fit  into  a  developing  architecture 
(that  is,  instantiate  the  library  module  for  a  specific  architecture). 
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A  prototype  graphic  interface  for  the  design/redesign  environment  was  specified.  The 
specification  includes  browsing  through  the  knowledge  base  from  different  viewpoints,  and 
constructing  a  SADT-like  diagram  from  the  information  in  the  knowledge  base.  The  SADT 
diagram  is  expected  to  become  one  method  the  user  can  us*  to  describe  system  requirements  and 
changes  to  system  design.  SADT's  expressibility  was  modified  and  extended  to  enable  the  display 
of  the  contents  of  the  knowledge  base. 

Important  Findings  and  Conclusions 

The  research  performed  under  this  contract  resulted  in  a  large  number  of  evolutionary 
improvements  in  our  understanding  of  the  power  and  limitations  of  knowledge-based  systems. 
These  findings  are  contained  in  an  extensive  library  of  technical  reports,  which  are  listed  in  the 
appendix. 

Significant  Hardware  Development  N/A 

Special  Comments 

The  Knowledge  Systems  Laboratory  has  a  long  tradition  of  attention  to  technology  transfer,  and 
we  continued  to  emphasize  that  activity  during  the  course  of  this  contract.  In  each  topic  area  the 
research  results  have  been  documented  in  books,  journal  articles,  technical  reports  and  tutorial 
notes  Where  appropriate,  the  knowledge-based  technology  has  been  transferred  to  other 
universities,  industrial  research  laboratories  and  defense  companies  in  the  form  of  software.  An 
example  of  that  transfer  process  took  place  with  Boeing  Computer  Services.  Computer  scientists 
from  BCS  spent  time  at  the  KSL  learning  to  use  the  blackboard  system  BB1.  They  then  installed  the 
software  on  their  equipment  at  BCS  and  developed  an  extended  version,  called  ERASMUS.  This 
system  was  then  used  by  personnel  at  the  Boeing  Military  Air  Center  to  develop  a  prototype  control 
system  for  a  head-up  display  on  the  Advanced  Tactical  Fighter. 

Implications  for  Further  Research 


This  research,  which  continues  previous  research  on  knowledge-based  systems,  has  demonstrated 
the  power  of  knowledge  as  the  performance  driver  in  intelligent  systems.  The  "knowledge  is 
power"  hypothesis  can  be  elevated  to  a  principle,  based  on  the  evidence  accumulated  over  the  past 
15  years.  However,  we  can  now  see  more  clearly  the  limitations  of  current  generation  knowledge- 
based  systems  -  their  over-specialization  and  their  brittleness  when  faced  with  novel  problems  - 
and  the  implications  therein  for  further  research.  If  future  systems  are  to  be  robust  problem 
servers  like  the  human  experts  they  emulate,  they  must  be  given  far  greater  and  more  basic 
knowledge  than  they  now  have.  We  need  to  find  ways  to  represent  and  use  knowledge  about  the 
world  at  multiple  levels  of  detail,  to  be  able  to  formulate  qualitative  as  well  as  quantitative  models 
of  objects  or  processes  and  use  these  models  to  predict  and  explain  behavior  when  compiled 
knowledge  doesn’t  apply  to  the  situation  at  hand.  Further  research  in  building  large,  shared, 
multi-use  knowledge  bases  is  clearly  implied. 
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